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SIGNAL PROCESSING APPARATUS AND METHOD THEREOF 

BACKGROUND OF THE INVENTION 
Field of -the Invention 
5 The inventrion relates tro a signal processing 

apparatus and method for processing an i„.age signal of 
en image pickup apparatus such as a digital camera or 
fj the like. 

Related Background Art 
1 ^QXr><.if3j> 2 Shows a construction of a conventional 

I signal Wocesslng apparatus using image pickup devices 

ni complementary color system. Color filters of 

□ °^ (magenta), g (green), Cy (cyan), and 

ye (yellow )\ as shown in Fig. 3 are adhered to the image 
15 pickup devices every device in order. An output signal 
from the imagX piekup device is transmitted through an 
OB (Optical BlLk) circuit 201, an individual 
difference vari^ion correction circuit (pixel gain 
Circuit) 202, WbV White Balance) circuit 203, and an 
20 offset circuit 2o4 and separately supplied to a 

luminance signal formation processing system and a 
chroma signal formaUon processing system. 

m the luminance signal formation processing 
system, a gain level difference which is caused by the 
25 eolor filters 1. removed by a low pass filter (notch 

Circuit) 215 and a clamping process is performed to a 
luminance signal by a Y clamp circuit 216. 
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Subsequently, an edge emphasis ±s performed by an APC 
(aper-tur-e) circuit 217. A le^rel correction by color 
difference signals is performed by a Y compensation 
circuit (Ycomp circuit, luminance signal compensation 
circuit) 218. Thus, the luminance signal becomes a Yh 
luminance signal of 8 bits by a Y gamma (Y-Gamma, 
luminance signal gamma correction) circuit 219 having 
conversion characteristics as shown by a curve 502 in 
Fig. 5. 

In the chroma signal formation processing system, 
the signal is interpolated by a color interpolation 
circuit 205 as if there were values in all pixels of 
four colors. A conversion of (the complementary colors 
-■> pure colors - color difference) is performed by a 
color matrix circuit (color conversion circuit) 206. A 
subtle correction of a chroma signal is performed by a 
linear clip matrix circuit 207. Subsequently, a gain 
of chroma signal in a saturation luminance area is 
suppressed by a C-SUP (chroma suppression) circuit 208. 
A band of the chroma signal is limited by a low pass 
filter 209. After tbat, a saturation is adjusted by a 
chroma gain circuit 210. Thereafter, the chroma signal 
is again converted into RGB signals by a matrix circuit 
211 by a low band Y£ signal and the color difference 
25 signals - 

The low band RGB signals become RGB (red, green, 
blue) Signals of 8 bits by a c gamma (chroma signal 
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gaxcma correction) c±xeu±1: 213 having the conversion 
characteristics as shown by the curve 502 In Fig. 5. 
subsequently, the RGB signals are converted into color 
difference signals Cr and Cb by a color conversion 
5 circuit 214. 

An image signal Is formed by the Yh signal from 
the luminance signal formation processing system and 
the Cr and Cb signals from the chroma signal formation 
processing system . 

10JS^S^g>4^ver, When the luminance signal and the chroma 
signal ^ gamma converted Into the signal of the same 
number ofVitg as in the above conventional technique, 

^ the followiJ^ problems occur. 

-/yS^^ aWrally, each of RGB of an output range of a 
15 monitor \^ an output apparatus consists of 8 bits and 

there are ^mma characteristics as shown by a curve 401 
in Fig. 4. ^output of the camera is a linear signal 
in which, for ^ample, each of RGB consists of 11 bits. 
It is, therefore\necessary to non-linearly compress 
20 (gamma conversion) W camera output to the signal of 

the number of bits oVthe output apparatus in 
- /Q ^°°^^ance with the characteristics of the monitor. 

^ TWefore, although the linear conversion of the 
ttl^ luminan^ signal is preferable to prevent a 

25 deterioration of the hue, when the linear conversion is 
performed, image becomes a dark image due to an 

influence by\the gamma characteristics of the monitor. 
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ToXaccurately reconstrucrt -the gradations of the 
lumknance, therefore, a reverse gamma conversion of the 
monitor characteristics as shown by a curve 402 in Fig. 
4 (a ^urve 504 in Fig. 5) is performed. Although there 
is a s:^ght deviation of the hue, the accurate 
gradatidp reconstruction of the luminance is held. if 
there is Wuch a gamma curve, however, the image becomes 
an image ^ich lacks a contrast in a middle luminance 
area of a iXain object. 
10 ^/V-^(^>iVLtherto, therefore, a gamma curve which can 

enhance\a contrast of a draw area (middle luminance 
area) of\the main object as shown by the curve 502 in 
Fig. 5 isWsed or a plurality of gamma curves according 
to the application are selectively used in accordance 
with a mode\ In case of using the data of the curve as 
shown by the\ curve 502 in order to improve the contrast 
Of the main ^biect, it is necessary to further reduce 
the gradationk in the low luminance area or high 
luminance area\ by an increased amount of the contrast 
in the middle luminance area. In this case, as shown 
in Fig. 5, particularly, in a high luminance and high 
saturation area W the chroma signal, an output signal 
difference betwein R and G in an output of the 8-bit c 
gamma circuit 2I3\ shown In Fig. 5(a) is smaller than an 
output Signal dlf Lrence between R and G of the 8-bit C 
gamma circuit at tke timing before the gradations of 
the middle luminancje area in Fig. 5(c) are increased. 



15 



20 




- 5 - 



the katurat±on ±s deteriorated, and the output signal 
^ diffeVenoe between B and G is not largely changed, so 

that the hue is remarkably deviated. There are. 



consequ^tly, such drawbacks that the color 
5 reconstrt^tlon of the high luminance area of the image 
after the ^mma conversion deteriorates, the image is 
likely to biv^white skipped, and a discoloration occurs. 
J^^^ ^ example of the conversion of the chroma signal 

in casA of the gamma system when the conventional 8-bit 
10 C gamma Vurve 502 is used will be mentioned 
hereinbexbw . 
<1> 8-bit C-gamma 

(a) Before gamma (11 -bit RGB) 
R = 1400 

15 G = llOO 

B = 400 

(b) After gamma (8-bit RGB) 
R = 236 

G = 228 
20 B = 140 

Yh = 0.3R + 0.59G + O.llB = 221 

(c) RGB-YCrCb conversion 

Y£ = 0.3R + 0.59G + O.llB = 221 
Cr = R _ Y = 15 
25 Cb = B - Y = -81 

(d) MIX with Yh signal on the output apparatus side 
Yh = 220 
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R = Cr + Yh = 235 
B = cb + Yh = 139 
G = (Yh - 0.3R - O.llB)/0.S9 
= 212 



A ratio Of the level differences among the signals 
of RGB remarkably differs as compared with that of the 
signals before the gamma conversion (refer to Fig. 
5(a)). Thus, the image becomes a picture whose hue 
changes and which is white skipped. 

SUMMARY OF THE INVENTION 

The Invention is made in consideration of the 
above drawbacks and it is an object of the invention to 
provide a signal processing apparatus In which a color 
crush in the high luminance area of the image after the 
gamma conversion can be fairly reduced and the white 
3kip Of the image and the discoloration are remarkably 
impr-oved . 

To accomplish the above object, according to an 
aspect of an embodiment of the invention, there is 
pr-ovided a signal processing apparatus which can output 
a Chroma signal of m bits as a chroma signal of n bits 
by an output apparatus, comprising: a gamma converting 
unit for gamma converting the chroma signal of m bits 
into a Chroma signal of k bits; a color converting unit 
for converting the chroma signal of k bits obtained by 
the gamma converting unit into a signal of k bits 
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showing a brightness and a color tone; and bit 
con..erting unit for converting the signal of k bits 
showing the brightness and color tone obtained by the 
oolor converting unit into a signal of n bits showing a 
brightness and a color tone, wherein m > n = k + 1 . 

According to another aspect of the invention, 
there is provided a signal processing method which can 
output a chroma signal of m bits as a chroma signal of 
n bits by an output apparatus, comprising: a gamma 
converting step of gamma converting the chroma signal 
of m bits into a chroma signal of k bits; color 
converting step of converting the chroma signal of k 
bits Obtained in the gamma converting step into a 
signal of k bits showing a brightness and a color tone; 
and a bit converting step of converting the signal of k 
bits showing the brightness and color tone obtained in 
the color converting step into a signal of n bits 
showing a brightness and a color tone, wherein m > n = 



k + 1 



The above and other objects and features of the 
present invention will become apparent from the 
following detailed description and the appended claims 
with reference to the accompanying drawings. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a construction 
Of a signal processing apparatus of an embodiment of 
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•the inven-hion; 

Fig. 2 is a block diagram showing an example of a 
constx-uction of a conventional signal processing 
apparatus ; 

Fig. 3 is a schematic diagram showing an example 
of complementary filters; 

Fig. 4 is a graph showing gamma characteristics of 
a monitor as an output apparatus; 

Fig. 5 is a graph showing a curve for performing 
each gamma converting process; 

Fxg. 6 is a graph showing a conversion curve of a 
toit adjustment circuit 120; and 

Fig. 7 is a diagram showing an example of a 
conversion from chroma signals (RGB) to chromaticity 
signals (U, V). 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An embodiment of the invention will now be 
described in detail hereinbelow with reference to the 
20 drawings . 

Fig. 1 shows a circuit construction of a signal 
processing apparatus according to an embodiment of the 
invention. 

/ (t^ -^^^blacdc component is removed from a complementary 

LP^ Signal Wgcyve) from image pickup devices (not shown) 

by an oA (optical Black) circuit 101 and a variation of 
the image\ pickup devices is corrected by a pixel gain 
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oiWt: 102. After that, a white halanoe ±s corrected 
by a\wB (White Balance) circuit 103 and a predetermined 
amounX: of offset is added by an offset circuit 104. 
outputWgnal Of the offset circuit 104 is separately 
inputteci^o the luminance signal formation processing 
system ank chroma signal formation processing system. 

In the luminance signal formation processing 
system, a color filter level difference is removed by a 
notch filter (Y-lpf) circuit 115, a clamping process is 
performed to the luminance signal by a Y clamp circuit 
116, and an edge is emphasized by an APC (aperture) 
Circuit 117. An output signal of the APC circuit 117 
is corrected by a Y compensation circuit 118 by the 
color difference signals. A gamma correction is 
performed by a Y gamma circuit 119 by using the C gamma 
curve 504 of 8 bits in Fig. 5, so that the signal 
becomes the Yh signal (luminance signal) of 8 bits. 

In the Chroma signal formation processing system, 
the dropped pixels of all o£ four colors are 
interpolated by a color interpolation circuit 105 and 
the signal is converted into the complementary colors 
(MgCyYe) ^ pure colors (RGB) ^ luminance color 
difference (Yia,R _ y,b - Y) signals by a color matrix 
Circuit 106. After a subtle color correction was 
performed by a linear clip matrix circuit 107, a color 
suppression of a saturation area is performed by a C- 
SUP (chroma suppression) circuit 108. An output of the 
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C-SUP Circuit 108 ±s band Ixmxted by a low pass filter 
circuit 109 . 

-g-^T^e R-y and b-y color difference signals (±11 
bits) vkich were band limited by the low pass filter 
5 circult\l09 are sent to a chroma gain circuit llO and 

saturatiUs are adjusted. The signals again become the 
RGB signils (11 bits) by a matrix circuit 111 by using 
an output\ signal from the chroma gain circuit llO and 
the low bj^d luminance signal Y£. An output of the 
lO matrix circuit 111 is gamma converted by a C gamma 
circuit liai. 

the embodiment, an output range of the C gamma 
circuiA 113 is set to 9 bits, thereby increasing a 
gradient of a gamma curve in a luminance area at a 
15 predetermined level or higher. An output range of the 
V gamma ciVcuit 119 is set to 8 bits. Output signals 
(RGB, 9 bi4) Of the C gamma circuit 113 are converted 
into YCrCb (Wcb = ±8 bits (c9)) signals by a color 
conversion circuit 114 and adjusted to the signals of 
20 the number of Wts (CrCb = *7 bits (c8)) of the output 
apparatus such Us a monitor or the like by a bit 
adjustment circuit 120. (The luminance signal which 
is formed by the\color conversion circuit 114 is not 
outputted to the i^utput apparatus. ) 
2^6^^h^RC5B Signals set to 8 bits (c9) are formed by 
UP-^ using th^^h signal set to 8 bits from the luminance 

Signal fo^atlon processing system and the CrCb signals 
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setVo ^7 b±i:s (c8) from l=he oharoma signal formation 
^^^^ proo^slng system and outputted to the output apparatus 

such ^s a monitor or the like. 
X/vJ S An ef ^ot of the improvement o£ the color 

5 gradation redJsmstruction which is obtained by 

increasing theVmber of output bits of the C gamma 
«=ii-cuit 113 as a\iain component element of the 
^ embodiment will be\lescrifaed hereinbelow. 

I jTnl^B,^ IrA^e embodiment, the number of bits of the gamma 

lO conversioWf the chroma signal is set to be larger 
m ^^^^ o^the luminance gamma conversion, thereby 

1 preventing a >^terioratlon of the color gradations. a 

U ^^"^^ ^\ ^ ^ 9^°^^ ^^^^ Of 9 bits ana a 

y gradient of the Wrve in a range from the middle 

m 15 luminance area toVhe high luminance area can be 
I increased than tha^f the 8-bit gamma curve 502 

because the maximum ^tput is larger than that of the 
8-bit gamma. Therefor^ a level difference among the 
RGB Signals after the g^m,a conversion does not change 
20 to a level larger than thV of 8 bits of c gamma. 

Thus, the saturation in thiyhigh luminance area is 
hardly deteriorated (refer t^Fig. 5(b)). 

The 9 -bit RGB Signals after the gamma conversion 
are subjected to an 8-bit limitation of a non-linear 
25 process by the bit adjustment circuit 120. in this 

oase, although the CrCb signals are bit limited to the 
9-bit (±8 bits (c9)) signals, since the color 
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difference signals do not become extremely large 
if the number of bits of the RGB signals Is larger than 
8, the color reconstruction is not deteriorated. 

Fig. 6 is a diagram showing input (±8 bits (c9)) - 
5 output (±7 bits (c8)) characteristics of the bit 

adjustment circuit 120. When either the Cr signal or 
the Cb signal enters a non-linear area at a 
predetermined input level or higher and is gain 
corrected, the other color difference signal is also 
lO multiplied by the same gain, thereby preventing the hue 
from changing. when both Cr and Cb signals enter the 
non-linear area and are gain corrected, those two gains 
are compared. The smaller gain is selected and 
multiplied to Cr and cb. 
15J./V^/3/^An eJ^nple of the gamma conversion using the 

output chara^t^istics of RGB 9 bits according to the 
embodiment wiliS^ mentioned hereinbelow. 

(a) Before gamma (11-bit RGB) 
R = 1400 

20 G = llOO 

B = 4O0 

(b) After gamma (9 -bit RGB) 
R = 239 

G = 242 
25 B = 140 

(c) RGB-YCrCb Conversion 

Yil « 0.3R + 0.59G + O.llB 
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= 239 
Cr = R - y = 30 
Cb - B - Y = -99 
(d) Bit; adjustment (±8 bits ±7 bits) 



Cb -99 

"""^^^ (frhere is no change in the example because the 
input signal levels of the bit adjustment circuit lie 
within the linear areas.) 
10 (e) MIX (synthesis) with Yh signal on the output 

apparatus side 
Yh = 220 
R = Cr 4- Yh 
= 251 
15 B = Cb + Yh 

= 121 

G = (Yh - 0.3R - 0.11B)/0.59 
= 223 

As mentioned above ^ the outputs o£ RGB which are 
20 obtained are based on 

conversion by the 9 -bit gamma curve 503 
(R, G, B) = (251, 121, 223) 
in response to 

conversion by the 8 -bit gamma curve 502 
25 (R, B) = (235, 139, 212) 

JITv'^ Qjy^ rj^e saturation in case of the C gamma curve 503 of 
IjJ^ 9 bits Vs stronger than that of the C gamma curve 502 
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ft '"^ ^bits, the deviation of the hue is also smaller 

'XriSQ/p> Acciwrdlng to the embodiment with the above 

construction, by setting the number of output bits of 
5 the gaimna cWersion of the chroma signal to a value 

larger than i^at of the luminance gamma conversion and 
by using the g^a curve which does not reduce the 
gradations of t4 high luminance area, a deterioration 
of the color grad^ion reconstruction of the 
lO reproduction image prevented. 
^^C^lj^ ^ example, when the number of input bits of the 
output Wparatus such as a monitor or the like is equal 
■to 8, in\ the signal processing apparatus of the 
embodimeAt; the input of the Y gamma circuit is set to 
15 11 bits, ks output is set to 8 bits, the input of the 
C gamma circuit is set to 11 bits, and its output is 
iil *° ^ ^n^- setting the output of the c gamma 

p circuit to ^bits as mentioned above, when the 8-bit 

gamma is useA, the gradient in the luminance area at 
20 the 3aturated\ predetermined level or higher can be set 
to be larger, Wnd the color crush can b^ fairly 
reduced . \ 

y TO f oW the final RGB image signals by mixing with 
the output Wninance signal Yh of the Y gamma circuit, 
25 the output sVgnals (RGB, 9 bits) of the C gamma circuit 

are color conWted into the YCrCb signals. The CrCb 
signals obtain^ by the color conversion are non- 



- lineWly operated to the bit width (±7 bits) of the 
outpik apparatus in accordance with the bit width of 
IjJ^ o'Vput apparatus. m the non-linear arithmetic 

operat:Ln, even if the RGB signals have the range of 9 
5 bits, tri^e color difference signals do not increase 

extremel^ so long as the saturation and the illuminance 
are not aLnormally large. Even if the signals after 
the color difference conversion are non-linearly 
converted ^d the number of bits is reduced, a 
resultant piWure is not adversely influenced. 
Therefore, if\ the C gamma curve as shown by the curve 
503 in Fig. 5 Us used, for example, the color 
reconstruction! white crush, and change in hue 
(discoloration)! in the high luminance area are 
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remarkably improved. 



in 



[Another embodiment] 

X.r^ ^ e>/^ k^ixQ^^^ the CrCb conversion has been performed 
the colJ^ conversion circuit 114 in the embodiment, 
YUV conv^ion can be also performed in accordance with 

20 a format oWhe output apparatus at the post stage. In 
this case, ^hroma signal conversion is executed in 
the color conWsion circuit 114 by using the following 
arithmetic operktions. 

Y = 0.2990 X R ^. 0.587O x G + 0.1140 x B 
^^TN^eit converted Y signal is not actually outputted 

to the oc^put apparatus. ) 

V = 0.5000 X R - 0.4187 x G - 0.0813 x B 
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U = -0.1684 X R - 0.3316 x G + 0.5000 x B 

The choromatxoxtY sigi^als U and V obt:ainet3 by the 
color oox^vezTsion circuit: 114 as shown in a conversion 
example of Fig. 7. 
5j.r^-^S^^^ ^^^^ performing the CrCb conversion in 

the colc^conversion circuit 114, if the maximum output 
Of the C ^ma circuit 113 is set lest the output 
exceeds ±7Wts (in the embodiment, it is sufficient to 
set the maximum output to 365 or less), such a 
construction What one upper bit is omitted and only 
eight lower bits are outputted can be obtained in the 
bit adjustment circuit 120. With respect to UV 
conversion, sa^e process can be applied. According to 
such construction, a burden of processes in the bit 
adjustment circuVt i20 at the post stage is reduced. 



